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(g) Method of use of multiple input styli In a system of multiple computersw 



@ In a system of multiple computers connected by a network means (12), a method for using multiple 
input styli (16,22), each connected to an individual computer (14,20), to indicate input infomriation on the 
display screen of any computer in the system. In a system in which there are many computers, a user of 
one computer (14) may wish to Indicate an input action on a second computer (20). In the present 
invention, all pens in a system are able to detennine which computer they are writing on and an input 
position relative to that input computer, regardless of whether they belong to that computer, by 
detemnlning an identifying "signature" of the computer based on the peak signal strength of a plurality 
of distinguishable signals in a complex signal produced on the computer display screen and sensed by 
the stylus. Each stylus is able to communicate with the software entity which can correctly interpret the 
measurement by using a computer network. 
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The present invention relates to a method for in- 
teractiveiy interfacing with a system consisting of 
multiple computers. More specifically, the invention 
relates to techniques for providing a multiple comput- 
er system with multiple input styli, each stylus being 5 
able to interface with any one of multiple computer 
displays in the system. 

Most present stylus, or "pen," input systenr^ for a 
computer consist of a stylus which either produces or 
detects an electrical signal. The stylus is placed 10 
against a piece of some signal medium, typically with 
a large surface area, which performs the conjugate 
function. For example, a piece of specially prepared 
glass might cover a computer display, or be incorpo- 
rated as a computer display screen. Either case may 15 
be referred to as a "display screen." Whenever a sty- 
lus approaches or touches the display screen, the 
stylus may measure a signal which varies across the 
glass surface. Alternatively, the stylus may emit a 
signal which is measured at the perimeter of the 20 
glass. In either case, the position of the stylus can be 
calculated. The system consists of a signal source, a 
signal detector, and an interface to a computer. For 
example, a square wave may be generated by the 
stylus or screen, and the receiving screen or stylus 25 
detector converts the serial data into digital words 
which indicate position. The sending apparatus, and 
the receiving apparatus that belongs to it, must share 
a common time base for the encoded data to be cor- 
rectly recognized. 30 

Various display systems are known which incor- 
porate the capability for printing or writing onto a dis- 
play screen, with a detector for sensing and encoding 
the location of the input device on the display screen 
and accurately determining input coordinate posi- 35 
tions. US-A-3,857,022, acoustically locates the pos- 
ition of a stylus tapped against a screen. US-A- 
4,514,688 determines the distance of a pointer posi- 
tion from a predetermined reference point by meas- 
uring magnetostrictively induced strain waves. US-A- 40 
No. 4,839,634 describes a portable electro-optic de- 
vice preferably comprising a flat panel display, pen- 
sensing surface, and a pen, with means provided for 
sensing and encoding the position of the pen on the 
display surface. 45 

Along with location sensing, positional accuracy 
is obtained by using methods for correcting for distor- 
tions and abnormalities in the regular array or the 
screen surface. US-A-4.678,869 describes an appa- 
ratus, system and method which employ a surface 50 
which is excited with an a.c. source at terminal loca- 
tions disposed at the edges of the surface. Reducing 
the area of grid elements at crossover positions and 
intermediate grounding terminals minimizes disrup- 
tive potential caused by capacitive coupling. A cor- 55 
rection look-up table is developed as part of the man- 
ufacture of the apparatus to provide a regularly Incre- 
mented sequence of address values developed from 



a signal domain computation. US-A-4,650,926 pro- 
vides correction for graphic surface non-linearities in 
an electrographic system wherein output readings are 
taken along a physteal domain rectangular grid array, 
and these output readings are adjusted in their signal 
domain to establish a regularly incremented se- 
quence of address values. 

Some systems, such as described in US-A- 
4,814,552, may incorporate multiple Input styli for a 
single computer by supplying identifying information 
in the encoded bitstream. An acoustic signal from 
each stylus is designed to be easy to convert to a lo- 
cation, and each contains a distinctive identification 
code so that the system can determine which stylus 
is the signal source. 

One aspect that all of the above-mentioned sys- 
tems have in common is that the device or devices 
supplying input signals and the device receiving the 
signals must share a common time base in order for 
the Input signal to be correctly recognized. 

A problem arises, however, in a system incorpor- 
ating a family of multiple connected computers, each 
with an individual input device. In a system in which 
there are many computers, a user of one computer 
may wish to indicate an input action on a second conv 
puter. In an existing system, an input actbn could only 
be Indicated on a computer using the device that is 
connected with that specific computer. 

Ideally, a user using a first computer would like 
to use the stylus belonging to that first computer to 
indicate an input action on any of the family of conrv 
puters in the multiple computer system. For example, 
a user of a portable computer with a pen input may 
walk up to a display for a second user's computer The 
first user would like to Indicate an input location on 
the second user's display, and points to the location 
on the second display with the pen from the first conrv 
puter. A sensing input device for the first computer 
must be able to tell which computer display it is touch- 
ing and approximate location coordinates for the pos- 
ition it is pointing to. 

This problem can be soked by providing a meth- 
od or system in accordance with the accompanying 
claims. In such a method or system there are provid- 
ed means to calculate the position of a stylus with re- 
spect to a computer display surface that may be in- 
dependent of the computer to which the stylus is con- 
nected 

In the system of the present Invention, all pens In 
a system are able to determine which computer they 
are writing on and an input position relative to that in- 
put computer, regardless of whether they belong to 
that computer, by determining an identifying "signa- 
ture** of the computer. Each stylus is able to commu- 
nicate with the software entity which can correctly in- 
terpret the measurement by using a computer net- 
work. Each stylus must be able to participate in the 
measurement of its location on any computer in the 
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system, without sharing a time base with that com- 
puter. The present invention provides a method for 
the input device to discern useful information con- 
cerning position even though that device belongs to 
another computer. s 

The present invention additionally provides an in- 
put signal to the system which contains information 
about the input device source allowing the computer 
being acted upon the ability to distinguish what conv 
puter device is providing the input, so that that com- 10 
puter can determine access rights and other informa- 
tion relating to the input device. Both frequency and 
time domain calculations may be used to recover sty- 
lus position and signal source information from the 
stylus detectbn measurements. 15 

The present invention provides a position input 
device which can be used with one or more computer 
video display terminals which are each indicative of 
the display of a different computer. The input device 
of the present invention employs a pointer as complex 20 
signal receiver Furthermore, the device according to 
the present invention may employ more than one 
pointer at a time, with each pointer resulting in a dis- 
tinct position input. 

A method is disclosed for using a position input 25 
device connected to a first computer to indicate a lo- 
cation on a second computer in a system of multiple 
computers connected to each other through a net- 
work. A composite signal comprising distinguishable 
signals indicativeoftheslgnatureofthe source is pro- 30 
duced. An input location is selected on the second 
computer display screen with the input device of the 
first computer, and a signal is sensed at that location. 
The distinguishable signals In the composite signals 
are used to determine relative coordinates of the in- 35 
put location on the second computer. 

The invention provides input styli which partici- 
pate in measurement of location on a computer dis- 
play without sharing a time base with that computer. 
Further, there is provided a multiple com puter system 40 
in which the input device belonging to any individual 
computer in the system is able to input Information in- 
cluding location on any of the family of computers in 
the multiple computer system 

Input information to a computer from individual 45 
input styli not necessarily connected directly to that 
computer may be distinguished, so that the computer 
may concurrently recognize the location and Identi- 
ties of each of one or more input styli. The invention 
allows an input stylus to input position information to so 
a computer that it is not necessarily connected to. 

There may thus be provided a system in which a 
significant number of computer input devices are sep- 
arately distinguishable to any computer in a multiple 
computer system. 55 

A method and system in accordance with the In- 
vention will now be descrit)ed« by way of example, 
with reference to the accompanying drawings, in 



which:- 

Fig. 1 shows a multiple computer system. 

Fig. 2 illustrates a display screen such as might 
be associated with a computer in the multiple comput- 
er system. 

Fig. 3 shows an example of a composite signal. 
Fig. 4 is a plot of energy components versus fre- 
quency. 

Fig. 5 describes a method performed by the com- 
puter to which the input device belongs for obtaining 
Input information. 

Fig. 6 describes a method performed by the com- 
puter which the input device is pointing to for using 
the input information from Fig. 5. 

Fig. 7 shows a block diagram of system that might 
be used to perform the technique of the present in- 
vention. 

A. General Features 

Fig 1 shows a computer system 10 comprising at 
least two computers 14 and 20, connected for com- 
municating via a communication network 12. An Input 
device 1 6 is "connected to," or "belongs to," computer 
14, and a second input device 22 belongs to computer 
20. In the figure shown, input device 16 is shown as 
a stylus device, connected by a wire 18 to computer 
14. It is clear that it need not necessarily be connect- 
ed by a wire, but could also be connected to the conv 
puter it belongs to via infrared or radio type signals, 
for example. 

In existing systems, stylus 16 would only be rec- 
ognizable as an in put device for computer 14, to which 
it belongs. The stylus and computer typically share a 
time base to allow recognition of parameters of the 
computer. A stylus which is not familiar with the time 
parameters of a given computer would not be able to 
discern any useful information from the signals 
transmitted by that computer. 

However, in a system such as computer system 
10, It Is desirable for the user of computer 14 to be 
able to indicate an input action on computer 20 with 
stylus 16 (without changing styli), and for computer 
20 to recognize input information from stylus 16, and 
recognize stylus 16 as belonging to computer 14. in 
this case, it is necessary for stylus 16 to be able to 
interact with computer 20, even though it does not be- 
long to it. 

Fig. 2 illustrates a display screen 30, as might be 
associated with a computer such as computer 14. 
Screen 30 has electrodes 32, 36. 38, 40, shown at the 
corners, which are used to drive signals across the 
screen. The geometry of the screen is not limited to 
the shape shown, and the screen may have many 
more than four electrodes along the edges of the 
screen, may use electrodes located at the midpoints 
of the screen, and the electrodes might be wide as 
well as point electrodes. However, for the purpose of 
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the present discussion, it is convenient to consider 
only four point electrodes, one at each of four corners 
of a rectangular screen. 

Electrical signals are driven across screen 30 in 
order to set up approximate grid lines, such as shown 5 
by line 42. This is done by driving a sine wave signal 
at a first frequency, fi, at a given peak energy value, 
say 1 Volt, onto one edge of the screen from two elec- 
trodes such as 32 and 36. A signal of the same fre- 
quency, but half the energy (y2Volt), is driven onto the io 
screen from the opposite edge, from electrodes 38 
and 40. This will form an energy field of frequency 
that is stronger at grid line 42, towards the edge of 
electrodes 32 and 36, and weaker at grid line 44, to- 
wards the edge of electrodes 38 and 40. A second fre- 15 
quency f2 is driven in the same way but from the op- 
posite sides, so that f2 is strong at grid line 44, towards 
the edge of 38 and 40, and weaker at grki line 42, to- 
wards the edge of 32 and 36. Similarly, a third fre- 
quency fs is driven onto the screen so that It is strong 20 
at the top of the screen at the edge of 32 and 40, and 
weaker near the bottom edge of 36 and 36. A fourth 
frequency ^4 is driven from the bottom edge of 36 and 
38 to the top edge of 32 and 40. 

At each electrode then, a signal is driven onto the 25 
screen which contains a composite of the frequency 
signals (2, and The signal driven onto the 
screen at electrode 32, may be described by: 
fi(1V) + f2(V2V) +/3(1V)+ ^4(^/2V). 

Each electrode will drive a slightly different conv 30 
posite signal onto the screen. For example, the signal 
driven at electrode 36 may be described by: 
fi(1V) + f2(^^V) + UV^SJ) + f4(1V). 

The result of driving the composite signals onto 
the glass will be an approximately linear electrical 35 
pattern of grid lines such as shown on screen 30. Ad- 
ditional composite signals may be driven at additional 
electrodes, perhaps forming diagonal grids, to in- 
crease the positional accuracy. 

If the stylus is touching input point 46 on the aq 
screen.the position of point 46 can be determined by 
measuring the composite signal and detecting the 
peak signal strength of each frequency. So that the 
user is able to determine both the position and gain 
of the signals, there nnust be at least two frequencies 45 
in each dimension to determine the two unknown val- 
ues. A ratio of the signal strength of the two signals 
in each dimension may be used to determine the pos- 
ition in that dimension. 

A signal may be added equally to the composite 50 
signals at each electrode and will have approximately 
the same peak signal strength at that frequency 
across the screen. 

An example of a composite signal that might be 
measured is shown in Fig. 3. It can be seen that signal 55 
52 is a composite of sine waves. Using well-known 
sampling techniques and fast Fourier transform (FFT) 
calculatk)ns, signal 52 can be sampled at various 
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points and separated into energy components repre- 
senting the amplitude of the signal at each frequen- 
cy, such as shown In Fig. 4 in the plot of energy conrv 
ponents versus frequency. 

In the energy plot in Fig 4, energy components 
are shown for each of a number of frequencies Each 
energy component represents the amplitude of the 
signal at that frequency. These components may be 
used to determine the position of the input device de- 
tecting these frequencies, as well as a "signature" of 
amplitude components of the frequencies in a pat- 
tern which Identifies the source of the signal. For ex- 
ample, signals fi, fz, and U discussed in relation 
to the description in Fig. 2 may produce component 
set 62 which indicates position on the screen. Further 
frequencies fs, fy, f^, fg, fio> ^11. and fi2. represented 
by the set of components 64. may be added to the 
composite signals. 

These frequencies /». fi, ^10. '11. and U2 
would be added equally at each electrode, so that the 
signature of the screen would be the same at all pos- 
itions on the screen. Different frequencies within a 
band of frequencies, or similar frequencies with dif- 
ferent amplitudes or phase, may be applied for each 
different screen, thereby producing a different signa- 
ture for each screen and computer Each screen must 
have a distinguishable digital signature, controlled by 
the frequencies generated on the screen. The screen 
which is being pointed to by the input device can be 
identified by any other computer which is pointing to 
it by identifying its signature. The components are 
shown in sets 62 and 64 for illustrative purposes. 
Clearly, the frequencies and amplitudes for identify- 
ing position and signature may be interchanged or in- 
terleaved as appropriate for the system. 

Alternatively, each computer screen may be 
identified by the frequencies that are used for posi- 
tion location (i.e., one computer may use fn^r lij. 
and fn^, and a second computer use f^^, f^^, f}^, and f^^.) 
The signal strengths may indicate relative position, 
while the frequencies used may themselves indicate 
the signature of the screen. However, in such a sys- 
tem the number of possible frequency combinations 
would then be limited, so that the number of sepa- 
rately distinguishable computers in the system must 
be limited. Considering the peak signal strength of 
each frequency in determining the signature determi- 
nation, and using separate signals for position deter- 
mination, allows a significantly higher number of 
computers to be used in the system than if the fre- 
quency alone is indicative of the signature. 

Further, time-domain signals may be used to 
supplement frequency-domain information. For ex- 
ample, binary data describing the signal source "sig- 
nature" might be used to vary the amplitude of a sig- 
nal at a frequency, the amplitude variation being re- 
peated indefinitely The computer receiving the signal 
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from the input device wili track the amplitude of the 
signal at that frequency until the complete series of 
amplitude variation is recorded. This series of ampli- 
tude variations then Is used to identify the signature 
of the source. 

Figs. 5 and 6 describe a method of obtaining the 
information as described in relation to Figs 3 and 4. 
The steps in Fig. 5 are performed by the computer 
which is connected with the Input device, such as by 
computer 14 and stylus 1 6 shown in Fig. 1 . This need 
not necessarily be the same computer which the input 
device is getting information from. The step in box 80 
receives an input signal such as signal 52 in Fig. 3. 
The step in box 82 converts this analog signal into en- 
ergy components versus frequency information, e.g., 
set 64 in Fig. 4. indicative of the frequencies in the 
signal using standard signal processing techniques. 
The step in box 84 uses component set 64 informa- 
tion to determine the signature of the input signal, 
and therefore, the signature and identity of the 
source The computer may also distinguish a stylus 
signature or function selection information, depend- 
ing on the needs and capabilities of the system. 

The step in box 86 uses component set 62 infor- 
mation to determine a "raw (x,y)" input point location 
based on the ratio of the frequency amplitudes. The 
step in box 88 sends this raw (x,y) value, with any ad- 
ditionally obtained function or stylus information to 
the appropriate source computer as determined from 
the source signature via the network connection of 
the system. 

The steps in Fig. 6 are performed by the comput- 
er which the input device is pointing to, such as com- 
puter 20 being pointed to by stylus 16 in Fig. 1. As 
mentioned above and shown in the figure, this may 
not be the computer which the input device belongs 
to. The step in box 100 receives the raw (x.y) point lo- 
cation In the step in box 102, the correction factors 
which apply to that specific surface are used with the 
raw (x,y) location to obtain an actual position on the 
screen. These correction factors nnay be previously 
determined by any of the many well-known methods 
for normalizing a screen, such as used in US-A- 
4,678,869 or US-A-4.650.926. 

Function or selection information from the input 
device, such as might be indicated by pushing a but- 
ton on a pen, may be added to the input signal, de- 
tected by the connected computer, and transmitted to 
the source computer along with the location informa- 
tion. 

B. An implementation 

Fig. 7 shows a block diagram of a system that 
might be used to perform the technique of the present 
invention The diagram shows a computer 112 which 
is connected to a multiple computer system 152 
through a network connection 150. This connection 



could be any kind of system network, such as a wired 
or wireless local area network. Computer 112 has 
connected to it display 122 and input stylus 140. Dis- 
play RAM 114 contains information for driving the inv 

5 age on the display as well as for generating the fre- 
quency information which will be driven onto each 
electrode of the screen. In the implementation 
shown, the display RAM is divided into sections which 
contain information for the top and bottom halves of 

10 a liquid crystal display (LCD). This data is used to 
form the display innage 120 which is shown on LCD 
display 122. 

RAM 114 also contains a data area 130 that 
stores data which is used to generate frequency data 

15 for the screen, which is used for providing the position 
grid and signature of the screen. In the implementa- 
tion shown, eight individual bits of data are used to 
provide eight independent signal sources These 
sources can be used to drive eight separate electro- 

20 des on the screen. Each of the eight data lines pro- 
vides pulse code modulated digital data through data 
Integrators 132, which may be low pass filters, to de- 
rive analog frequency screen signals 134 which are 
driven onto the screen as described in relation to Fig. 

25 2. The actual frequencies used in a system will be de- 
pendent upon many engineering factors, including 
but not limited to the technology of the screen and in- 
put devices, optimum voltages for the devices used 
and power requirements of the system. 

30 Input stylus 140 picks up signals from a screen 

(which may be screen 122, or the screen from an- 
other computer in the system [not shown]), which are 
detected and converted into frequency component In- 
dicators by detector 142. The resulting frequency 

35 components are used by the identity and position log- 
ic 144 to determine the source and relative input pos- 
ition data. This data may be acted upon by computer 
112 if it is determined to be the source, or the data 
may be sent via network 150 to the appropriate 

40 source computer (not shown) in computer system 
152. Function selection information may also be sup- 
plied via input stylus 140. 

In the system shown, the screen of display 122 
may consist of a piece of glass with a resistive coating 

45 with a ring of metal electrodes, such as is found on 
many available "pen input" computer systems. Input 
stylus 140 is a solid brass pen device such as is used 
in some pen input systems. The brass tip provides a 
good conducting surface that is relatively soft and 

50 has no partrcles or sharp edges to scratch the resis- 
tive coating of the glass. 

C. Miscellaneous 

55 Although shown with a system of two computers 
and two input styli, the method is designed to enable 
a system with large numbers of individual computers, 
each separately distinguishable by the screen signa- 
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10 



ture of the computer display or displays connected to 
that computer. 

The system is not limited to computers with sin- 
gle input styli devices. Clearly, a computer with two 
or more styli which belong to it could perform the 5 
method of the invention for each of its styli, providing 
information to the source computer indicating which 
individual styli selected the input position along with 
computer and position Identification information as 
described above. io 



Claims 

1. A method for determining an input location on a is 
display screen of a first computer in a system of 
multiple computers connected to a communica- 
tions network, wherein each computer comprises 
a display screen and an input device, comprising 
the steps of: 20 

producing an identifying signature of the 
first display screen; 

determining said identifying signature in- 
dicating identity of said first display screen; 
and 25 

determining relative coordinates of a 
sensing input device input location on the first 
display screen. 

2. The method of daim 1 , wherein the step of pro- 30 
ducing an identifying signature further compris- 
es: 

generating a complex signal field on the 
first computer screen so that at any location on 
the screen there exists a composite signal com- 35 
prising a plurality of distinguishable signals in- 
cluding signals indicative of said identifying sig- 
nature. 

3. The met hod of daim 2, wherein the step of deter- 40 



mining said identifying signature further com- 
prises: 

sensing a composite signal with a sensing 
input device at a location on the first display 
screen; and 

distinguishing said identifying signature 
indicative signals in said composite signal. 

4. The method of claim 2 wherein the composite 
signal further includes signals indicative of posi- 
tion on said first computer display screen, and 

the step of determining relative coordin- 
ates of an input location further comprises sens- 
ing a composite signal with a sensing input de- 
vice at a location on the first display screen; 
and 

distinguishing said position indicative sig- 
nals in said composite signal. 



5. A method of using a position Input device con- 
nected to a first computer to indicate an input lo- 
cation on a second computer, the first and sec- 
ond computers being independent computers 
connected to each other through a communica- 
tions network, the first computer having a display 
screen, and the second computer having an input 
pointing device, the method comprising the steps 
of: 

producing a composite signal comprising a 
plurality of distinguishable signals; 

selecting an input location on the first 
computer display screen with the second conrv 
puter input pointing device; 

sensing said composite signal at said input 
location; 

distinguishing said distinguishable signals 
in said sensed composite signal; 

identifying said first computer from said 
distinguishable signals; and 

determining relative coordinates of said 
input location on the first computer display 
screen from said distinguishable signals. 

6. The method of daim 5, further comprising a step 
of sending said relative coordinates of said input 
location to the first computer through the con- 
necting communications network. 

7. A system of multiple computers connected to a 
communications network, wherein each comput- 
er comprises a display screen and an input de- 
vice, the system being characterized by: 

sensing input devices responsive to sig- 
nals from a display screen connected to a number 
of the computers; 

means for produdng an identifying signa- 
ture of each display screen; and 

means for determining said identifying 
signature indicating identity of a display screen. 

8. The system of daim 7, wherein said means for 
producing an identifying signature of each dis- 
play screen further comprises: 

45 means for generating a complex signal 

field on a first computer screen so that at any lo- 
cation on the screen there exists a composite 
signal comprising a plurality of distinguishable 
signals, said distinguishable signals induding 

50 signals indicative of said identifying signature. 

9. The system of daim 6, further comprising means 
for determining relative coordinates of a sensing 
input device input location on a first display 

55 screen. 

10. A system of multiple computers connected to a 
communications network comprising at least first 
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and second computers, wherein each computer 
comprises a display screen and an input device 
responsive to signals from a display screen, com- 
prising: 

means for producing a composite signal 5 
on the first computer display screen, said compo- 
site signal comprising a plurality of distinguish- 
able signals, said distinguishable signals Includ- 
ing signals indicative of an identifying signature 
of the first computer display screen, said distin- io 
guishable signals further including signals indi- 
cative of position; 

means for sensing said composite signal 
at a location on the first computer display screen 
pointed to by the second computer input device; 15 

means for separating said distinguishable 
signals in said composite signals; 

means for determining said screen signa- 
ture Indicating identity of said first computerfrom 
said separated distinguishable signals; 20 

means for determining relative coordin- 
ates of said second input device location on said 
first display screen from said separated distin- 
guishable signals; and 

means for sending said relative coordin- 25 
ates to said first computer through the communi- 
cations network connection. 
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